Comparison theorems on large-margin learning
نویسندگان
چکیده
This paper studies the binary classification problem associated with a family of Lipschitz convex loss functions called large-margin unified machines (LUMs), which offers natural bridge between distribution-based likelihood approaches and margin-based approaches. LUMs can overcome so-called data piling issue support vector machine in high-dimension low-sample size setting, while their theoretical analysis from perspective learning theory is still lacking. In this paper, we establish some new comparison theorems for all LUM play key role error algorithms. Based on obtained theorems, further derive rates regularized schemes varying Gaussian kernels, maybe independent interest.
منابع مشابه
Learning Large Margin Mappings
We present a method to simultaneously learn a mixture of mappings and large margin hyperplane classifier. This method learns useful mappings of the training data to improve classification accuracy. We first present a simple iterative algorithm that finds a greedy local solution and then derive a semidefinite relaxation to find an approximate global solution. This relaxation leads to the matrix ...
متن کاملLarge Margin Distribution Learning
Support vector machines (SVMs) and Boosting are possibly the two most popular learning approaches during the past two decades. It is well known that the margin is a fundamental issue of SVMs, whereas recently the margin theory for Boosting has been defended, establishing a connection between these two mainstream approaches. The recent theoretical results disclosed that the margin distribution r...
متن کاملLarge Margin Semi-supervised Learning
In classification, semi-supervised learning occurs when a large amount of unlabeled data is available with only a small number of labeled data. In such a situation, how to enhance predictability of classification through unlabeled data is the focus. In this article, we introduce a novel large margin semi-supervised learning methodology, using grouping information from unlabeled data, together w...
متن کاملLarge Margin Local Metric Learning
Linear metric learning is a widely used methodology to learn a dissimilarity function from a set of similar/dissimilar example pairs. Using a single metric may be a too restrictive assumption when handling heterogeneous datasets. Recently, local metric learning methods have been introduced to overcome this limitation. However, they are subjects to constraints preventing their usage in many appl...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: International Journal of Wavelets, Multiresolution and Information Processing
سال: 2021
ISSN: ['0219-6913', '1793-690X']
DOI: https://doi.org/10.1142/s0219691321500156